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[57] ABSTRACT 

A technique for identifying an object selected from a plu- 
rality of objects displayed on an output display is disclosed. 
The tedmique includes grouping the objects into a plurality 
of scenes based on natural groupings. An identifier for each 
object is generated that uniquely identifies each object 
displayed. The identifier is dynamically partitioned into **n*' 
segments based on the graphics subsystem, and each seg- 
ment is mapped to a color representation in the graphics 
subsystem. In response to user selection of one of the 
objects, location information, which identifies the location 
of an object on the display, is generated. During each of **n" 
tune intervals, a color mapped segment far each object is 
painted in a back buffor of a double buffered graphics 
subsystem, and the back buffer Is subsequently queded for 
the color at the user selected location. The segments arc 
accumulated to assemble the identifier for the selected 
object. 

18 Claims, 8 Drawing Sheets 
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METHOD AND APPARATUS FOR 
IDENTIFYING AN OBJECT SELECTED ON A 
COMPUTER OUTPUT DISPLAY 

BACKGROUND OF THE INVENTION 

1, Reld of the Invention 
The present invention is directed toward the field of 

graphical user interfaces, and more particularly to a tech- 
nique that readily identifies an object selected from a plu- 
rality of objects displayed on a computer output display. 

2. Art Background 

TVpically, graphical user interfaces display a combination 
of text and gr^hics on a computer ou^ut display. The 
textual and graphical display communicates information to 
the user about the underlying program (e.g. information 
pertaining to an operating system or an application 
program). One application for the display of textual and 
graphical information is to provide a means for a user to 
enter information into the conq)iiter to communicate with 
the undcriylng program. For example, in order to inqilement 
a tool or menu bar, a graphical user interface displays a 
plurality of objects or icons, and the user selects one of the 
objects to invoke a desired function. In response to the user 
selection, the underlying program displays additional infor- 
mation that relates to die object or icon selected. Therefore, 
to implement this paradigm, the gri^hical user interface is 
required to correlate the objects displayed with data asso- 
ciated with the objects. 

The graphical objects displayed on the output screen for 
selection by a user may be renderings of two dimensional 
objects or tiiree dimensional objects. Regardless of the form 
of the objects, there is a need to manipulate single items 
from within a visual context that permits a user to uniquely 
select an object from a screen image. In the prior art, 
graphics sub-systems manage pick buffers and pick identi- 
fiers to identify objects displayed on die screen. However, 
the pick buffers, and the pick identifiers that they store, are 
difficult to manipulate and manage. Other conventional 
solutions to identify objects include executing mathemati- 
caUy intensive reverse geometric calculations. The geomet- 
ric calculations are typically necessary for precisely com- 
puting spatial locations of singular points. The reverse 
geometric calculations are often used in engineering and 
scientific CAD or CAE systems. 

These prior art techniques often limit the size of an 
identifier that is used to uniquely identify each object 
displayed. However, if a display contains a large number of 
objects, then the identifier must be large enough to uniquely 
identify each object For example, in a display that includes 
numerous complex three dimensional objects, a large 
identifier, which may be as large as 128 bits, may be required 
to uniquely identify all the objects being simultaneously 
displayed. Therefore, it is desirable to provide an identifi- 
cation technique that does not limit the size of the identifiers. 
Fiirthcrmore, it is desirable to provide a technique for 
identifying selected objects that does not require executing 
conq)lex management and/or calculation routines. 

As is described fiiUy bdow, the present invention enables 
the user of a visual interface to point to an object on the 
ou^ut display, and to have the application immediately 
"see" the object in terms of this identifier, thereby allowing 
for direct manipulation and/or query of the object 

SUMMARY OF THE INVENTION 
A technique for identifying an object selected from a 
plurality of objects displayed on an output display includes 
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grouping the objects into a plurality of scenes based on 
natural grouping, such as hierarchical information structures 
and context/focus displays. A scries of ^obal unique iden- 
tifiers (GUIDs), relating to a particular scene; are generated 

5 to uniquely identify each object in a cancsponding scene. 
The GXJIDs firom each scene are then assembled to generate 
a composite universally unique identifier to uniquely iden- 
tify each object displayed. A user selects a scene, and in 
response, a series of global unique identifiers within the 

10 universally unique identifiers are identified. The user selects 
an object within the scene selected, and a global unique 
identifier within the series of GUIDs is generated to identify 
the object selected in the scene. The GUID is inserted in the 
con^osite UUID to uniquely identify the object from all 

15 objects displayed. 

In one embodiment, each GUID wittiin the selected scries 
of GUIDs is partitioned into **n" segments. Each segment of 
eadh identifier is mapped, in preparation for storage to 
memory, into a location such that die location corresponds 

20 to a location of an associated object displayed on the output 
display. The user selects an object, and in response, location 
information, whidi identifies the location of an object 
selected on the output display, is generated. 

During each of "n" time intervals, one time interval for 
each partitioned segment, a segment is stored in memory so 
that the locations of die segments stored in memory map to 
corresponding objects displayed on the output display. Dur- 
ing each interval and subsequent to storing the segment in 
memory, segments arc retrieved from the noemoiy at the 
location selected by the user through use of the location 
information. In this way, segments are extracted and accu- 
mulated to assemble the GUID for the selected object 
In one embodiments the segments of the identifier are 

3j stored in a t>ack huS^ of a double buffered graphics 
subsystem. For this embodiment, the segnients are mapped 
to a color representation in accordance with the graphics 
subsystem driving the output display. The configuration is 
dynamic sudx that the pixel capaci^ in the graphics sub- 

^ system is queried. Huough use of the pbtel capacity 
information, the mapping to the color representation is 
optimized. During each time interval, the back buffer is 
re-painted with the color r^rescotation for the current 
segment of each object Then, the back buffer is queried to 
extract the color at (he user selected location, and the 
segments are accuimilatcd to assemble the identifier for the 
objea selected. 

BRIEF DESCRIFnON OF THE DRAWINGS 

so FIG. la illustrates an example ou^ut display that displays 
a plurality of three dimensional objects. 

HG. W illustrates an example display that includes a 
context portion and a focus portion. 

FIG. Ic illustrates an example con^ositc UUID generated 
from a plurality of GUID's from scene objects. 

FIG. 2 is a block diagram illustrating one embodiment for 
a computer graphics sut)-system for whidi the present 
invention may be implemented. 
gQ FIG. 3 is a flow diagram illustrating a me&od for iden- 
tifying a selected object in accordance with one embodiment 
of the present invention, 

FIGS. 4a, 4^ and 4c illustrate the contents of the back 
buffer through du-ee re-paint iterations for an example 
65 display. 

FIGS. 5a and 5b are block diagrams illustrating one 
enibodiment for implementing Che present invention. 
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FIG. 6 illustrates a general purpose computer for which sents informatioD in a hierarchicai structure such that cones 
the present invention may be implemented. emanate from elements of a higher hierarchical level to 

elements in a lower hierarchical levcL The lower hierarchi- 
DETAILED DESCRIPTION OF THE cal level element provides more specific information about 

PREFERRED EMBODIMENTS 5 the element expanded by the cone. As a further example of 

a hierarchical infonnation structured a spatial structure of a 

As is described below, the present invention pera:iits a building may be utilized as a structural browser to identify 
user to select an object, displayed on a computer output people in an organization. The spatial structure building 
display or screen, and have the object be readily identified paradigm presents information about people located in dif- 
by the conaputer system. For purposes of explanation, an ^^^^ rooms and floors, analogous to their locations in a 
object is any pixel configuration that may be selected by a building. Another application for hierarchical information 
user. As will be apparent to one skilled in the art, the pr^nt structures is a menu in a graphical user interface that 
invention has a wide variety of applications for any program presents options to a user. The user selects a particular 
utilizing a screen display to receive information. category in a first hierarchical level to receive additional 

FIG. la illustrates an exaniple output display that displays menus and choices in a next lower hierarchical level, Hier- 
a plurality of three dimensional objects. Although FIG. la archlcal information structures have application as three 
shows an example display with three dimensional objects, dimensional browsers, such as a three dinmensional World- 
any objects, including graphical and/or textual objects, may wide Web browset A three dunensional Web browser 
be rendered for use with the present invention. For the language, known as the virtual reality modeling language 
example display shown in HG. 1^, the three dimensional ^ (VRML), is ideally suited to generating hierarchical scenes, 
objects displayed may graphically depict objects for mod- For more infonnation on a three dimensional browser 
eling an object oriented p-ogram. In order to select an object, language, sec the virtual reality modeling language 
a user, via an input control device, places a cursor on the (VRML), version 1.0 specification, May 26, 1995. 
desired object, and the user selects an object, via a keyboard addition to hierarchical information structures, some 

or cursor control device. Depending upon the application, ^ three dimensional display renderings contain a focus view 
the user may select an object to obtain further infcHmation additional context information such that there is a 

about the object (e.g. query the object) or to invoke an boundary, either geometrically, semantically, or both, 
operation, such as a function, tool or application program. between the focus and context views. FIG. V? illustrates an 

In one embodiment, the example display shown in FIG. example display that includes a context view and a focus 
la graphically depicts a plurality of objects in an object 30 view. In a typical application, the groupings are a result of 
oriented programming environment. For this example a user that selects an object or set of objects, pulls the 
system, a user selects one of the objects to obtain further selected objects into focus to make them global while 
information relating to the selected object (e.g. specific momentarily removing the rest of the context from the focus, 
methods, attributes, and interfaces for the objects selected). The exan^le display in FIG. lb shows object 11 brought in 
When an object is queried by a users the program retrieves 33 focus, while the remaining objects are displayed for context 
data associated with the object selected. For example, the As shown in FIG. lb, additional objects, 25, 26, 27, 28, 29, 
data may be utilized to render another display on the output and 30, are selectable from object 11 , the focused object The 
display or to provide information about the object selected. focused object 11 permits a user to select additional items 
Generally, in order to implement such a function, regardless directly on the object that were too small to select from the 
of the underlying application, data arc associated with and ^ broad level view. In addition, objects 12-24 retain context 
are subsequently retrieved for cadi object displayed. In one for object 11 such that the user may still visualize the entire 
embodiment, each object displayed has an associated data three dimensional structure for which object 11 is a part 
structure. thereof. 

In order to manage and manipulate data associated with The presentation of either hierarchical information struo- 
an object, each object contains an unique oonq)Utational 45 tures or context/focus displays results in a natural grouping 
identifier. For puiposes of explanation, the unique conq>u- of scene objects. For example, in the example display shown 
tational identifier associated with a graphically displayed in FIG. lb, object U, displayed in the foreground, may be 
object is referred to as a universally unique identifier characttxizcd as one scene, and the additional objects 12r-24, 
(UUID). For systems that render numerous graphical objects displayed in the background, may be characterized as a 
on a single display screen, a large universal unique identifier 50 second scene. As is described fully below, the selection 
field may be required to support a bit string of several tcchniqucof the present invention takes advantage of natural 
hundred bits. For example, a three dimensional rendering groupings of scene objects. As discussed above, a univer- 
may contain thousands of objects on a single display screen, sally unique identifier is assigned for each selectable object 
even though certain objects may be rendered with very few displayed on the screen. For a presentation having the 
pixels. To display thousands of objects, a graphical display 55 natural groupings, each scene area is assigned a partition of 
may appear as a cluster of objects in order to provide a broad a universally unique identifier (UUID). A unique bit con- 
level view of an intricate model or structure. For such a figuration in this partition is then assigned to a global unique 
display, in order to uniquely identify each of the thousands identifier that uniquely identifies an object in the scene area, 
of objects, a large universally unique identifier is required. Hiis unique bit configuration is defined as a global unique 
As is well known, a universally unique identifier requires ^ identifier (GUID). For this embodiment; tiie UUID is con- 
"n" bits to uniquely identify 2" objects . As is described more scructed by mapping a GUID for each scene into a con:^osite 
fully below, the techniques of the present invention permit universally unique identifier. 

use of large universally unique identifies that contain long FIG. Ic illustrates an example conq>osite UUID generated 
bit strings. from a plurality of GUID's from different scene areas. As 

One visual paradigm for presenting information to a user 65 shown in FIG. Ic, each object (12-24) contains a plurality 
is through use of hierarchical infonnation structures. For of selectable objects. Each of the selectable objects are 
example, a three dimensional cone tree visualization pre- identified in a global unique identifier that is dependent upon 
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the number of selectable objects in a particular scene area. being rendered at any one time. However, for any unique 

F6r example, for object 11, six selectable objects on object identifier, the actual number of partitions is governed by the 

11 result in a three bit global unique identifier, labeled posidon of the last non-zero bit in the original global unique 

"GTJIDir in the composite UUID shown in FIG. Ic. identifier field. Each unique identifier, which corresponds to 
Similarly, a global unique identifier GUID is generated fi'om 5 a displayed object, Is partitioned based on the color rcsolu- 

each scene object to assemble the con^osite UUID. As is tion of the pixel data stored in the fi-ame buffer as shown in 

described further bdofw, when there are natural groupings of ^iQck 320 in FIG, 3. For «can^)le, if the graphics sub-system 

scene objects, the technique focuses in on a particular scene ^^^^^ ^^^i^ in an 8 hit format, then the unique identifiers are 

area to generate the corresponding global unique identifier. partitioned into 8 bit segments. An exanmle of partitioning 

For aU objects in a particular foais scene or area, only the ^ ^ described below in conjunction with 

bit range corresponding to that focus area vanes, and all Table IL 

other bits in the UUID are held constant The length of the ^ ^ . t_. 1 ^^^^ ^ c t. • 

GUIDs for a focus area is adjusted to accommodate the ^ f ^ partition for eadi umquc 

number of selectable objects in the particular area. By identifierisinappedmto a color represeotabon such ttiat bits 

focusinginonasinglesceneareatheprocessingrequiredto from each partition are designated to speofy tte r^^ 

generate a GUID is greatiy reduced from the processhig ^^<^^^^ <^}^^ "^JTa^?^ ^ example of color moping 

Squired to genemte the entire UUID. ^ P^«^^ ^ <l^saibed below in conjunrtion wife T^ble IL 

nG.2isablod.diagramillustratingoneembodimentfor decision block 330 of HG. 3, the user 

a computer graphics^system fo? which the present ^ ^^^^^ ^^^^"^ ^^^y* 
invention may be implemented. The graphics sub^systcm „ After the user selects an object, itaative re-paints arc 

200 is a double buffered display system. Specifically, tiie executed to the back buffer 210 (HG. 2). The number of 

graphics sub-system 200 contains a back buffer 210 and a re-paints corresponds to the number of segments, "n", that 

frame buffer 220. In a double buffered graphics sub-system, were partitioned for the unique identifieis. SpedficaUy, as 

such as graphics sub-system 200, pixd data arc first painted illustrated in block 340 in HG. 3, the back buffer 210 is 

in the back buffer and then subsequently transferred to the re-painted with the first partition of each unique identifier for 

frame buffer. The output display is rendered based on the each object The first back buffer repaint occurs during a first 

contents of the frame buffer. In general, double buffered interval. Also, during the first time interval, the color is 

graphics sub-systems permit the generation of coiiq)lex queried at the object location selected by flie user as shown 

graphical images in the back buffers which may require in block 350. From the color obtained in the query operation, 

extensive processing to generate, while a previously ren- ^ bit sequence is extracted as shown in block 360. 

dcred image is currcntiy displayed in the front or frame Specifically, the bit sequence for a partition is extracted from 

jjy^gj the color representation by extracting the entire pixel value 

As shown in FIG. 2, the backbuffer 210 receives data and tiie location queried. The bit sequence extracted is 

address information for painting storing pixel data to ^^ti^c^ to the bit sequence fo" the first partition of the 
render objects. The back buffer 210 is coupled to the frame ^ unique identifier. 

buffer 220 for fast transfer of pixel data from the back buffer As shown by the decision block 370 and blocks 340, 350, 

210 to the frame buffer 220. In addition, as shown in FIG. and 360, the back buffer repaints, the color queries, and the 

2, die contents of the back buffer 210 may also be bit sequence extractions are executed **n" times, one for each 

transferred, via a bus, to additional areas of the con^)Uter, partition. Fa: example, if the length of the longest identifier 

such as the main memory of the computer system. The back is 24 bits, and the gr^hics sub-system stores 8 bits of pixel 

buffer 210 may be controlled by either a dedicated graphics data, resulting in 3 partitions, tiien the back buffer repaint, 

proccssorcff may be controlled by the central processing unit color query, and bit sequence extraction operations are 

(CPU)of the computer. In one embodiment, the back buffer executed 3 times. In order to properly reconstruct the 

210 cozriprises fast access static random access memory original global unique identifier, each iteration of the repaint, 
(SRAM). 45 query, and extraction occurs in a specified time interval, such 

The front buffer or frame buffer 220 comprises a video that the repaint and subsequent color query and bit extrac- 

random access memory (VRAM). In one embodiment for operations are synchronized. Since the back buffer 210 

tfie graphics subsystem 200, tiie frame buffer 220 transfers is being painted but not visually rendered, the user never 

pixel data, in a serial bit stream, to a random access memory visuaUy sees the iterative repaints, but only sees the original 
digital to analog converter (RAM DAC) 250. The RAM 50 viewing stared in die image in the frame buffer 220. 

DAC 250 receives the pixel data, and it utilizes the pixel data As shown in block 380 in FIG. 3, the unique identifier is 

as an index to a color look-up table in the RAM DAC 250. reconstructed by assembling the bit sequences extracted for 

In addition, the RAM DAC 250 converts the output of the each partition of the selected object In a preferred 

color look-up table to an analog signal to drive the output embodiment, the unique identifiers are partitioned such that 
display. Hie graphics sub-system 200 is representative of a 55 the first partition corresponds to the most significant bits of 

typical double buffered system, and in fact is intended to the unique identifier: For this embodiment, to assemble the 

represent a broad category of graphics processing systems unique identifier, a bit sequence, which starts with ttie first 

that utilize a double buffer. partition of the global unique identifier and ends with the nth 

FIG. 3 is a flow diagram illustrating a mediod for idcn- partition, is obtained by appending subsequent partitions on 

tifying a selected object in accordance with one embodiment 60 end of the first partition (e.g., the bit sequence extends 

of the present invention. As shown in block 300, the objects from the first partition to the nth partition from right to left), 

are rendered for display on the output display. Specifically, Consequentiy, the unique identifier that ccnesponds to the 

in the graphics sub-system 200, tiie objects are painted in the bit location selected is readily generated, 

back buffer 210, and then they are subsequently transferred FIGS. 4a, 4ir and 4c illustrate the contents of the back 
to the frame buffer 220 for display on the ou^ut display. $s buffer through three re-paint iterations for an exan^le 

As discussed above, the length of the unique idoitifier, display. As discussed above, the back buffer is not rendered 

either the UUID or GUID, is based on the number of objects on the output display; however, the display of the back 
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buffer illustrated in FIGS. 4c, 4b and 4c demonstrates the 
le-paint iterations in the back buffer. For this example, the 
unique identifier is partitioned into three segments, and the 
output display contains three selectable objects, labeled 510, 
520 and 530, that are rendered as three dimensional boxes. 
FIG. 4a illustrates the diree dimensional boxes for a first 
re-paint, which occurs in a first time interval, for the first 
color mapped partition. The shadings shown in FIGS. 4a, 4b 
and 4c represent coIots stored in the back buffer. FIG. 46 
illustrates the three dimensional objects during a second 
time interval. Note that for this exanqjle, object 520 in FIG. 
4a is the same color as object 530 in FIG, 4b. This is a result 
of the first partition in the unique identifier, which identifies 
object 520, being the same as the second partition in the 
unique identifier that identifies object 530. Although colors 
of objects may be the same in one or more time intervals, the 
aggregate composite of the entire unique identifier yields a 
unique bit sequence. FIG. 4c illustrates a third partition, 
re-painted in a third time interval, for the example back 
buffer re-paint. 

As discussed above, for natural grouping selection 
applications, a series of GUIDs are generated for each scene 
area. The technique for selecting objects is then reduced to 
the scene GUIDs by focusing in on the corresponding scene. 
To accon^)lish this, header bits are appended onto the UUID 
that identify each scene area. Id operation, a user selects a 
scene area firom a display containing a plurality of scene 
areas. For example, for the exan^de displays illustrated in 
FIGS, la and lb, a user selects object 11 from the scene 
display in FIG. 1<j, and the display of FIG. lb is generated 
in response. The header bits are utilized to identify each 
scene area in a selection technique analogous to generation 
of a unique identifier (e.g. the method illustrated in FIG. 3). 

In a preferred embodiment, the header bits are utilized to 
identify an entry in a table or data stracture. The table 
contains, for each scene, an offset in length to identify the 
location and length of the series of GUIDs in the conqwsite 
UUID. 

Table I illustrates an example data structure for storing an 
offset in length for exan^le scenes. 



Sc«iieo 


0£Fseta>ength 


Scenci 


OfEsctLUngth 


Scene, 


0£Eset.Length 


Scene m-2 


OCEsetO^ngth 


Scene m-l 


OSsctO^eastb 


Sceoe m 


OffsetiLength 



The offset in length for the spedfled scene is then used to 
'focus in" on the GUID fot the corresponding scene area. 
Note that if the scene area contained multiple hierarchical 
levels, then multiple header bits are utilized to define scene 
areas in each hierarchical level. For each hierarchical level 
in a multiple hierarchical information structure, the selection 
technique is executed to identify a scene. For example, a first 
set of header bits in the UUID composite may be utilized to 
identify scenes in a first level of a hierarchical information 
structure. Similarly, a second set of header bits may be used 
to identify the second level of scene areas in the multiple 
hierarchical information structure. Although the present 
invention is described in conjunction with the use of header 
bits to focus in on a particular natural grouping cf scene, any 
nuqjping to m^ scenes in natural grouping selections may 
be utilized without deviating firom the spirit and scope of the 
invention. 
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As discussed above, the length of each partition or seg- 
ment in the global unique identifier Is based on the number 
of bits stored to represent a pixeL This factor is d^endent 
upon the graphics subsystem utilized. For example, a graph- 

5 Ics sub-system may store 8 bits per pixel The 8 bit pixel 
value may subsequently be transformed into a 24 hit repre- 
sentation in the RAM DAC 250. TUble n below shows an 
example identifier that is partitioned in accordance with an 
8 bit per pixel graphic sub-system. For this example, the full 

10 identifier is: 

-loiiioioiooioouoouiooioiiiouiioiooni." 



TABLE n 



20 



Partitions 


R 


G 


B 


Partiticm 1 


101 


no 


10 


PartitiGsi 2 


100 


100 


11 


Partition 3 


001 


no 


Oi 


Partition o-l 


on 


101 


11 


Partitkm n 


* 101 


001 


11 



As shown in Table II, the exait^le unique identifier is 
partitioned into 8 bit segments. Specifically, for this 
exan^le, the unique identifier is partitioned into 5 partitions 

25 ( e.g. "n** is equal to 5). In order to color map the bits in a 
partition for this example, the first three bits define the red 
value, die second three bits define the green value, and the 
last two bits define the blue value. 
In the preferred embodiment, the size of the segment is 

30 maximized to accommodate the pixel storage size for the 
particular gr^hics subsystenL In order to maximize the 
selection technique of the present invention, the number of 
bits per storage location and subsequently the number of **n" 
segments are dynamically determined. For this embodiment, 

33 the graphics subsystem is queried to determine the number 
of bits stored per pixeL For the software in^lementation, a 
call to a graphics driver is executed to obtain the pixel 
storage capacity information. With the pixel storage 
infonnation, the identifier is partitioned into *'n*' segments, 

40 and eadi segment is mapped into a color representation for 
the particular graphics subsystem. The dynamic configura- 
tion permits optimizing the selection technique such that a 
larger pixel storage capacity results in a smaller "n" for a 
given identifier. If the number of "n** segments is reduced 

45 due to a larger pixel storage capacity, then fewer iterations 
to generate the identifier are required, resulting in a faster 
process. 

FIGS. Sa and Sb are block diagrams illustrating one 
embodiment for implementing the present invention. In 

50 general, the technique for selecting objects from a display 
may be inq>lement«l in either software or hardware. For the 
preferred software embodiment, the method is accomplished 
through the execution of a plurality of computer readable 
instructions on a general purpose Gonq>uter. A general pur- 

55 pose computer is described more fully bdow. 

An identifier assigner 405 assigns a global unique iden- 
tifier for each object in a scene, and it assembles the global 
unique identifiers from all scenes into a composite oniver- 
sally unique identifier that uniquely identifies each object 

60 displayed. A scene identifier 415 receives selection infw- 
mation that identifies a scene selected by a user, and it 
identifies the corresponding global unique identifiers for a 
selected scene. In one embodiment, the operation of the 
scene identifia is analogous to the general operation of the 

65 global unique identifier generator described below. The 
scene identifier 415 outputs the GUIDs fw the selected 
scene. 
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Id geaexa], the global unique identifier gcneiator includes 
a unique identiiiex partitioiier 400, a partition distributor 
410, a colcH- mapper 420, and an object painter 450. As 
shown in FIG. Sa, the unique identifier partitioner 400 
receives global unique identifiers for objects being rendered 5 
on the selected scene. The unique identifier partitionex 400 
partitions eadi identifier as discussed above. The partition 
distributor 410 distributes the partition bits of the identifier 
based on the location of the objects being rendered on the 
output display. For example, if an object is rendered in the lo 
upper left comer of the output display, then the partition 
distributor 410 generates coordinates for a corresponding 
identifier partition, for each re-paint interactioD, to re-paint 
the identifier mapped color to the upper left corner in the 
backbuffa. is 

The color mapper 420 maps the bits in each partition for 
each object to the appropriate color (e.g. reds green, and 
blue). The object painter 430 then re-paints the back buffer 
with the new pixel data in the locations identified by the 
partition distributer 410. As shown in FIG. 5a, the partition 20 
distributor 410» color m^pcr 420, and object painter 430 are 
executed "n** times for **n" re-paint reiterations to the back 
buffer 210. 

FIG. Sb illustrates one embodiment for extracting the 
unique identifier for the objects selected The pixel querier 25 
4^0 receives the pixel color at the selected location. In 
general, the color is obtained by reading the pixel data in the 
back buffer 210 at the user spedfied location. In the software 
embodiment, the pixel color is obtained from a call to a 
gr^hics routine that retrieves the color at a screen location 30 
selected by a user. For more infonnation on extracting a 
color via a software routine, see Neider, Davis, Woo, Open 
GL Programming Guide; Addison-Wesley; 1993. The pixel 
querier 460 receives, each time interval, a color represen- 
tation f<x^ the user selected location. A partition extractor 450 35 
extracts the bits from the color rq)resentation. Subsequently, 
the unique identifier assembler 440 assembles the bit 
sequence to reconstruct the unique identifier for the object 
selected. A UUID assembler 470 then assembles the GUID 
generated into a UUID composite to uniquely identify the 40 
selected object from all objects displayed. 

In the realm of abstract information objects, the queries at 
precise singular locations on renderings of such objects are 
usually not necessary. The present invention has an advan- 
tage over the pick buffer technique because a pick list 45 
imposes a predefined limit on the number of selectable 
objects in a single ouq)ut display. This limitation may not be 
sufficient for the potential richness in the number of objects 
being displayed Furthermore, the management of pick 
buffers introduces additional programjuatic complexity 50 
when selection capability is implemented. The present 
invention has application for selection of any type of object 
display (e.g. two dimensional or three dimensional 
renderings). For example, the selection technique of the 
present invention has application in mechanical and/or eleo 55 
tronic CAD or CAE. 

The selection technique of the present invention provides 
a sdesction mechanism with scalability that is measured by 
the number of objects being rendered, the maximuTn unique 
identifier magnitude, and the pixel color resolution of the 60 
output display. Furthermore, the selection technique of the 
present invention requires programmatic complexity no 
greater than what is already in place to render the objects fc^ 
viewing. A key {»^operty to accomplish this technique is the 
boundlessness of the number of selectable objects through 65 
the leveraging of the time domain to acconunodate selecting 
any unique identifying range. 
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After recovering the unique identifier for a selected 
object, it is used to access data corresponding to the object 
selected. In one embodiment, the unique identifier is used as 
an entry to an array. The airay stores a plurality of pointers 
that identify the location in memory of the coiresponding 
data stnictures. Through use of the array, access to the data 
coonesponding to the object selected is readily accessible. 
Although the selection technique of the present invention is 
directed toward recovering the unique identifier for a 
selected objects the unique identifier may be used in any 
manner to identify a coiresponding data structure or data set. 

FIG. 6 illustrates a high level block diagram of a general 
purpose con^uter system in which tbc present invention 
may be implemented. A conq)uter system 1000 contains a 
processor unit 1005, main memory 1010, and an intercon- 
nect bus 1025. The processor unit 1005 may contain a single 
microprocessor, or may contain a plurality of microproces- 
sors for configuring the computer system 1000 as a multi- 
processor system. The main memory 1010 stores, in part, 
instructions and data for execution by the processes- unit 
1005. If the object identification system of the present 
invention is wholly or partially inoplemented in software, 
then the main memory 1010 stores the executable code when 
in operation. The main memory 1010 may include banks of 
dynamic random access memory (DRAM) as well as high 
speed cache memory. 

The computer system 1000 further includes a mass stor- 
age device 1020, peripheral device(s) 1050, portable stor^e 
medium drive(s) 1040, input control device(s) 1070, a 
gr^hics subsystem 1050, and an ou^ut display 1060. For 
purposes of simplicity, ail components in the computer 
system 1000 are shown in HG. 6 as being connected via the 
bus 1025. However, the conq)Uter system 1000 may be 
coimected through one or more data transport means. For 
example, the processor unit 1005 and the main memcsy 
1010 may be connected via a local microprocessor bus, and 
the mass stwage device 1020, peripheral device(s) 1030, 
portable storage medium drive(s) 1040, gr^hics subsystem 
1050 may be connected via one or more input/ouq)ut (UO) 
busses. The mass storage device 1020, which may be 
implemented with a magnetic disk drive or an optical disk 
drive, is a non-volatile storage device for storing data and 
instructions for use by the processor unit 1005. In the 
software embodiment, the mass storage device 1020 stores 
the object identification system software for loading to the 
main memory 1010. 

The portable storage medium drive 1040 operates in 
conjunction with a portable non-volatile storage medium, 
such as a floppy disk or a contact disc read only memory 
(CD-ROM), to input and output data and code to and from 
tiie conqmter system 1000. In one embodiment, the object 
identification software is stored on such a portable medium, 
and it is input to the computer system 1000 via the portable 
storage medium drive 1040. The peripheral device(s) 1030 
may include any type of coir^utcr support device, such as an 
input/output (I/O) interface, to add additional functionality 
to the computer system 1000, For example, the per^heral 
devioc(s) 1030 may include a network interfoce card for 
interfacing the computer system 1000 to a netw<?k. For the 
software i2xq)lementation, the documents may be input to the 
computer system 1000 via a portable storage medium or a 
network for processing by the object identification system. 

The input control device(s) 1070 provide a portion of the 
user interface for a user of the computer system 1000. Tlie 
input control device(s) 1070 may include an a^hanumeric 
keypad for inputting alphanumeric and other key 
information, a cursor control device, such as a mouse, a 
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trackball, stylus, or cursor direction keys. In order to display 
textual and graphical infoimation, the computer system 
1000 contains the graphics subsystem 200 and the output 
display 1060. The output display 1060 may include any type 
of display, such as a cathode ray tube (CKT) display or liquid 
crystal display (LCD). The graphics subsystem 200 receives 
textual and graphical information, and it processes the 
information for output to the output display 1060. The 
components contained in the computer system 1000 arc 
those typically found in general purpose computer systems, 
and in fact, these components arc intended to rq)resent a 
broad category of such computer components that are well 
known in the mt 

The object identification system of the present invention 
may be implemented in either hardware or software. For the 
software implementation, the object identification system is 
software that includes a plurality of computer executable 
instructions for inq>lementation on a general purpose com- 
puter systenL Prior to loading into a general purpose com- 
puter system, the object identification system software may 
reside as encoded information on a conc^uter readable 
mediuna, such as a magnetic floppy disk, magnetic tape, and 
coii^)act disc read only memory (CD-ROM). In one hard- 
ware implementation, the object implementation system 
may comprise a dedicated processor including processor 
instructions for performing the functions described herein. 
(Circuits, such as application specific integrated circuits 
(ASIC), may also be developed to perform the functions 
described herein. 

Although the present invention has been described in 
terms of specific exemplary embodiments, it will be appre- 
ciated that various modifications and alterations might be 
made by those skilled in the art without departing from the 
spirit and scope of the invention as set forth in the following 
claims. 

What is claimed is: 

1. A method for identifying an object selected from a 
plurality of objects displayed on an output display, said 
method compising the steps of: 

grouping said objects displayed into a plurality of scenes; 

generating, for each scene, a series of global unique 
identifiers to uniquely identify each object in a corre- 
sponding scene; 

generating a composite universally unique identifier from 
said series of global unique identifiers from each scene 
to uniquely identify each objea displayed; 

identifying, in response to user selection of a scene, a 
scries of global unique identifiers within said univer- 
sally unique identifier that identifies said scene 
selected; 

generating, in response to user selection of an object in 
said scene selected, a global unique identifier from said 
scries of global unique identifiers to identify said object 
selected; and 

assembling said global unique identifier generated in said 
coiiqx>site universally unique identifier. 

2. The method as set forth in claim 1, wherein the step of 
grouping said objects displayed into a plurality of scenes 
comprises the step of grouping said objects of a hierarchical 
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scene select, a global unique identifier to identify said 
object selected comprises the steps of: 
partitioning said global unique identifier into a plurality of 
*V segments; 

mapping each of said '"n** segments for said global unique 
identifier into a storage location such that said storage 
location maps to a location of an associated object on 
said output display; 

receiving location information, in response to user selec- 
tion of one of said objects, that identifies an ouQ)Ut 
display location of an object selected; 

storing, in a memory at said storage location, during "'n" 
time intervals, one of said '*n** segments for each 
identifier during each time interval; 

querying said memory at a location corresponding to said 
ou^ut display location of said object selected during 
each time interval to extract a segment; and 

accumulating each segment from each time interval to 
assemble said global unique identifier. 

5. The method as set forth in claim 4, wherein said 
memory comprises a back buffer in a double buffered 
graphics subsystem. 

6. The method as set forth in claim 5, wherein: 

the step of mapping each of said "n" segments for each 
identifier into a storage location comprises the step of 
mapping each of said **n" segments into a color teprc- 
sentation; 

the step of storing one of said '*n" segments for each 
identifier comprises the step of storing a color r^e- 
sentation for each segment; 

the step of querying said memory at a location of said 
selected object comprises the step of querying a color 
at said location to extmct a color representation; and 

the st^ of accumulating each segment from eadi time 
interval comprises the step of accumulating each color 
rq)resentation extracted to assemble said identifier. 

7. The method as set forth in daim 1, wherein the step of 
generating, in response to user selection of an object in said 
scene selected, a global unique identifier to identify said 
object selected comprises the stqjs of: 

receiving location information, in response to user selec- 
tion of one of said objects, that identifies an output 
display location of an object selected; 

storing, in a back buffer of a double buffered grajrfiics 
subsystem, a color representation for said identifiers; 
and 

querying a color in said back buffer at said location of said 
sdected object to extract said identifier. 

8. The mbethod as set forth in claim 7, wherein the step of 
storing a color representation for said identifiers in a back 
buffer comprises the steps of; 

partitioning said global unique identificx into a plurality of 
**n" segments; and 

mapping each of said *'n** segments into a color repre- 
sentation for said output display. 

9. The method as set forth in claim 8, further comprising 
the step of dynamically determining a per pixel storage 



information structure that includes a plurality of levels such €0 capacity fcsr said back buffer to maximize the partitioning of 



that each level corresponds to at least one scene. 

3. The method as set forth in daim 1, wherein the step of 
grouping said objects displayed into a plurality of scenes 
coix^^riscs the step of grouping said objects for focus and 
context scenes. 

4. The method as set forth in claim 1, wherdn the step of 
generating, in response to user selection of an object in said 
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said global unique identifier into said "n"" segments. 
10. The method as set forth in daim 8; wherein: 
the step of storing a color representation for said global 
unique identifiers comprises the step of storing, during 
"n" time intervals, a color representation for one of said 
*V* segments such that eadi color representation is 
stored in a separate time interval; and 
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the step of querying a coloa: in said badcbuffi^ comprises 
the steps of querying said color at said location of said 
selected object during each time interval to extract a bit 
sequence, and accumulating bit sequences from each 
time interval to assemble said global unique identifier. 5 

11. The method as set forth in claim 1, wherein the step 
of identifying a global unique identifier within said univer- 
sally unique identifier comprises the steps of: 

generating a header identifier to uniquely identify each 

scene in said display; 
partitioning said header identifier into a plurality of **n" 

segments; 

mapping each of said "n" segments for said header 
identifier into a storage location such that said storage 
location maps to a location of an associated object on 
said ou^ut display; 

receiving location infannation, in response to user selec- 
tion of one of said scenes, that identifies an output 
display location of a scene selected; 

storing, in a memory at said storage location, during **n" 
time intervals, one of said **n" segments for each header 
identifier during each time interval; 

querying said memory at a location corresponding to said 
output display location of said scene selected during 25 
eadi time interval to extract a segment; and 

accrnnulatlng each segment from each time interval to 
assemble said header identifier. 

12. A computer readable medium comprising a plurality 

of instructions for identifying an object selected from a 30 
plurality of objects displayed on an output display, said 
instnictions fOT: 

grouping said objects displayed into a plurality of scenes; 
generating, for each scene, a series of global unique 
identifiers to uniquely identify each object in a corre- 3^ 
sponding scene; 
generating a composite univenally unique identifier from 
said series of global unique identifiers from each scene 
to uniquely identify each object displayed; 
identifying, in response to usff selection of a scene, a ^ 
series of global unique identifiers within said univer- 
sally unique identifier that identifies said scene 
selected; 

generating, in response to usex selection of an object in 
said scene selected, a global unique identifier from said 
series of global unique identifiers to identify said object 
selected; and 

assembling said global unique identifier generated in said 
composite universally unique identifier. ^ 

13. The computer readable medium as set forth in claim 
12, wherein the instructions for generating, in response to 
user selection of an object in said scene selected, a global 
unique identifier to identify said object selected con^jrises 
the instructions for. 53 

partitioning said global unique identifier into a plurality of 
"n" segments; 

mapping each of said '^n** segments for said global unique 
identifier into a storage location such that said storage 
location maps to a location of an associated object on ^ 
said ou^ut display; 

receiving location information, in response to user selec- 
tion of one of said objects, ttiat identifies an output 
display location of an object selected; 

storing, in a memory at said storage location, during "n" 65 
time intervals, one of said *'n" segments for each 
identifier during each time interval; 
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querying said memosy at a location corresponding to said 
output display location of said object selected during 
each time interval to extract a segment; and 

accumulating each segment from each time interval to 
assemble said global unique identifier. 

14. The computer readable medium as set forth in daim 
13, wherein said memory conqirises a back buffa in a 
double buffered gri^hics subsystem. 

15. The computer readable medium as set forth in daim 
13, wherein: 

the instructions formapping each of said "n" segments for 
each identifier into a location comprises instructions for 
niapping each of said **n" segments into a color r^re- 
scntation for said output display; 

the instructions for storing one of said **d*' segments for 
each identifi^ comprises the insdiictions for storing a 
color representation for each segment; 

the instructions for querying said memory at said location 
of said selected object conqjrises instructions for que- 
rying a color at said location to extract a color repre- 
sentation; and 

the instructions for accumulating each segment from each 
time interval comprises instructions for accumulating 
each color representation extracted to assemble said 
identifier. 

16. A conc^uter system comprising: 

at least one input device for receiving input from a user; 

an output display for displaying information to a user; 

a graphics subsystem for displaying a plurality of objects, 
grouped in a plurality of scenes, on said output display; 

an identifier assigner for assigning a plurality of global 
unique identifiers, one for each scene, to uniqudy 
identify each object in a corresponding scene and to 
assemble a con:^)osite universally unique identifier 
from said global unique identifiers to uniqudy identify 
each object displayed; 

a scene identifier f (h* identifying a global unique identifier 
within said universally unique identifier, in response to 
user selection of a scene with said input device, that 
identifies said scene selected; 

a global unique identifier generator for generating, in 
response to user sdection of an object with said input 
device in said scene selected, a global unique identifier 
to identify said object sdected; and 

a universally unique identifier assembler for assembling 
said global unique identifier generated in said con^&- 
ite universally unique identifier. 

17. Tlie oon4)uter system as set forth in daim 16, wherein 
said global unique identifier generator conqxrises: 

an identifier partitioncr, that receives said global unique 
identifier for said scene selected, for partitioning said 
global unique identifier into a plurality of "n" seg- 
ments; 

mapper for mapping each of said '*n** segments for said 
global unique identifier into a storage location such that 
said storage location maps to a location of an associated 
object on said output display; 

memory for storing, at said storage location, during **n" 
time intervals, one of said "n" segments for each 
identifier during each time interval; 

a user input device for receiving location information, in 
response to user sdection of one of said objects, that 
identifies an ou^ut display location of an object 
sdected; 
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a queiiex coupled to said user input device for querying 
said memoiy at a location corresponding to said ou^ut 
display location of said object selected during each 
time interval to extract a segment; and 

an identifier assembler coupled to said queiier for accu- ^ 
muiating eadi segment from each time interval to 
assemble said identiiier. 

18. The corr^uter system as set forth in daim 17, wherein: 

said memory conqiiises a back buffer of a double buffered 
gr^hics subsystem; 
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said mapper contuses a color mapper for mapping each 
of said "n"* segments into a color representation and an 
object painter for st<»ing a color representation for each 
segment; 

said querier comprises a pixel querier for querying a color 
at said location to extract a color representation; and 
said identifier assembler for assembling said color repre- 
sentatioD extracted to assemble said identifier. 

***** 
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